Your 8GB Card Can Run a 35B Model. llama.cpp Won't Turn On the Part That Makes It Fast
llama.cpp now picks the GPU layers itself. The two settings it leaves to you decide whether a 35B model is usable on 8GB, and one ships switched off.
Read article